Papers by Gregory D Lyng
Fast and Effective On-Policy Distillation from Reasoning Prefixes (2026.findings-acl)
Copied to clipboard
Dongxu Zhang, Zhichao Yang, Sepehr Janghorbani, Jun Han, Andrew Ressler II, Qian Qian, Gregory D Lyng, Sanjit Singh Batra, Robert E. Tillman
| Challenge: | On-policy distillation (OPD) requires expensive on-the-fly sampling of the student policy during training, which substantially increases training cost. |
| Approach: | They propose to use on-policy distillation to sample trajectories from student model . they propose to terminate the sampling early during distillation . |
| Outcome: | The proposed method matches the performance of full OPD in long reasoning outputs while reducing training FLOP by 2x–40x. |